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Abstract  This  paper  addresses  the  problem  of  tracking  multiple  moving  targets 
by  recursively  estimating  the  joint  multitarget  probability  density  (JMPD).  Estimation 
of  the  JMPD  is  done  in  a  Bayesian  framework  and  provides  a  method  for 
tracking  multiple  targets,  which  allow  nonlinear  target  motion  and  measurement 
to  state  coupling  as  well  as  non-Gaussian  target-state  densities.  We  utilize  an 
implementation  of  the  JMPD  method  based  on  particle  filtering  (PF)  techniques. 
The  details  of  this  method  have  been  presented  elsewhere  [1]. 

One  feature  of  real  targets  is  that  they  are  poorly  described  by  a  single  kinematic 
model.  Target  behavior  may  change  dramatically,  i.e.,  targets  may  stop  moving 
or  begin  rapid  acceleration.  To  address  this  fact,  we  evaluate  the  use  of  the 
adaptive  target  tracking  strategy  known  as  the  interacting  multiple  model  (IMM) 
algorithm.  The  IMM  uses  multiple  models  for  target  behavior  and  adaptively 
determines  which  model(s)  are  the  most  appropriate  at  each  time  step  based  on 
sensor  measurements.  We  demonstrate  the  applicability  of  the  IMM  to  a  PF-based 
multitarget  tracker  in  two  settings.  First,  we  consider  the  traditional  application  of 
tracking  targets  that  switch  between  kinematic  modes.  The  target  motion  used 
is  field  data  recorded  during  a  military  battle  simulation  and  includes  multiple 
modes  of  target  behavior.  Our  investigation  is  distinguished  from  prior  efforts  in 
that  it  is  concerned  with  multiple  targets  and  real  target  motion  data,  and  utilizes 
a  PF  implementation.  Second,  we  present  a  nontraditional  reinterpretation  of  the 
multiple  model  filter  as  multiple  models  on  the  state  of  the  filter  rather  than  on 
the  state  of  the  target.  We  find  that  this  strategy  is  able  to  automatically  detect 
model  violations  and  compensate  by  altering  the  filter  model,  which  results  in 
improved  target  tracking. 
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ABSTRACT 

This  paper  addresses  the  problem  of  tracking  multiple  mov¬ 
ing  targets  by  recursively  estimating  the  joint  multitarget 
probability  density  (JMPD).  Estimation  of  the  JMPD  is 
done  in  a  Bayesian  framework,  providing  a  method  of  track¬ 
ing  multiple  targets  which  allows  nonlinear  target  motion, 
nonlinear  measurement  to  state  coupling,  and  non-Gaussian 
target  state  densities.  We  utilize  a  particle  filter  implemen¬ 
tation  which  has  been  detailed  elsewhere  [I /. 

Real  targets  are  poorly  described  by  a  single  kinematic 
model.  Target  behavior  may  change  dramatically  -  e.g. 
targets  stop  moving  or  begin  rapid  acceleration.  In  the  lit¬ 
erature,  the  Interacting  Multiple  Model  (IMM)  algorithm 
[4]  is  used  to  address  this.  The  IMM  uses  multiple  mod¬ 
els  for  target  behavior  and  adaptively  determines  which 
model(s)  are  the  most  appropriate  at  each  time  step. 

We  demonstrate  the  IMM  in  the  context  of  our  PF 
based  multitarget  tracker  in  two  settings.  First,  we  con¬ 
sider  application  to  targets  that  switch  between  kinematic 
modes.  The  target  motion  used  is  field  data  recorded  dur¬ 
ing  a  military  battle  simulation  and  includes  multiple  modes 
of  target  behavior.  Second,  we  present  a  nontraditional 
application  of  IMM  as  multiple  models  on  the  state  of  the 
filter.  In  the  context  of  PF  based  target  tracking,  this  tech¬ 
nique  may  be  viewed  as  a  (biased)  sampling  scheme  for 
particle  proposal.  This  strategy  adds  robustness  to  the 
tracker  as  it  is  able  to  automatically  detect  model  viola¬ 
tions  and  compensate  by  altering  the  filter  model. 


This  work  was  supported  under  the  USAF  contract  F33615-02-C- 
1 199,  AFRL  contract  SP0900-96-D-0080  and  by  ARO-DARPA  MURI 
Grant  DAAD 19 -02- 1-0262.  Any  opinions,  findings  and  conclusions  or 
recommendations  expressed  in  this  material  are  those  of  the  author(s)  and 
do  not  necessarily  reflect  the  views  of  the  United  States  Air  Force. 


1.  INTRODUCTION 

The  goal  of  target  tracking  is  to  estimate  the  state  of  a  target 
using  a  model  of  target  kinematics,  a  probabilistic  model 
of  a  sensor,  and  a  set  of  noisy  measurements.  Since  real 
targets  are  poorly  described  by  a  single  kinematic  model, 
researchers  have  developed  the  Interacting  Multiple  Model 
(IMM)  target  tracker  [4]  and  variants  such  as  VS -IMM  [6]. 

The  IMM  characterizes  a  target  as  behaving  according 
to  one  of  M  modes  (e.g.  stopped,  moving  with  constant  ve¬ 
locity,  or  accelerating).  Each  mode  has  an  associated  prob¬ 
ability.  Transition  rates  between  modes  (e.g  the  probability 
that  a  moving  target  stops)  are  defined  a  priori.  As  new 
data  comes  in,  mode  probabilities  adjust  based  on  agree¬ 
ment  with  measurements.  The  goal  is  to  correctly  estimate 
mode  probabilities  to  minimize  tracking  error. 

This  paper  contains  two  contributions.  First,  we  investi¬ 
gate  the  IMM  in  a  multi-target  tracking  environment  where 
target  motion  is  taken  from  real  recorded  data.  Using  a  mul¬ 
titarget  particle  filter  with  IMM,  we  investigate  the  tradeoff 
between  adaptation  time  and  steady  state  error.  Second,  we 
investigate  a  new  application  of  the  IMM,  where  the  state  of 
the  filter  is  modeled  rather  than  the  state  of  the  target.  In  the 
context  of  particle  filter  based  target  tracking,  this  can  be 
interpreted  as  having  multiple  (biased)  proposal  schemes  as 
the  models.  We  show  via  simulation  that  this  strategy  adds 
robustness  to  the  filter,  keeping  targets  in  track  more  often 
than  otherwise. 

The  paper  proceeds  as  follows.  In  Section  2,  we  briefly 
review  Bayesian  multitarget  tracking  and  the  standard  parti¬ 
cle  filter  based  implementation.  In  Section  3,  we  outline  the 
IMM  strategy.  In  section  4,  we  give  an  example  of  the  IMM- 
particle  filter  (IMMPF)  applied  to  the  problem  of  tracking 
two  targets  that  can  each  be  modeled  as  behaving  according 
to  one  of  2  modes  -  stopped  and  moving.  This  is  the  regime 
in  which  the  IMM  is  typically  applied,  although  most  of 


Filter  time  update  should 
be  according  to  measurements 


Figure  1:  A  top-level  view  of  the  two  interpretations  of  the  Interacting  Multiple  Model  strategy  considered  here. 


the  literature  uses  the  IMM  algorithm  in  conjunction  with 
a  Kalman  filter  tracker.  In  Section  5,  we  give  a  new  appli¬ 
cation  where  the  modes  are  associated  with  the  filter  rather 
than  the  target.  In  this  application,  the  IMM  estimates  the 
state  of  the  filter  rather  than  the  target. 

2.  BAYESIAN  MULTITARGET  TRACKING  AND 
PARTICLE  FILTERING 

We  track  a  collection  of  moving  targets  by  recursively  es¬ 
timating  the  Joint  Multitarget  Probability  Density  (JMPD). 
We  restrict  ourselves  to  the  case  where  the  number  of  targets 
is  known  and  fixed  although  the  framework  is  general. 

The  statistical  model  uses  the  joint  multitarget  condi¬ 
tional  probability  density  p(x*,  x2,  vikr\Zk)  as  the 

probability  for  T  targets  with  states  x  A ,  x2 ,  ...xkr  1,xt'r  at 
time  k  based  on  a  set  of  observations  Zk .  Zk  refers  to  the 
collection  of  measurements  up  to  and  including  time  k,  i.e. 
ZA  =  {z1,  z2, . ,.zA },  where  each  of  the  zl  may  be  a  single 
measurement  or  a  vector  of  measurements  made  at  time  i. 
Each  of  the  state  vectors  x,  is  a  vector  quantity  and  may  (for 
example)  be  of  the  fonn  [x,  x,  y.  y\  .  For  convenience,  the 
density  will  be  written  more  compactly  as  p(Xk  ZA),  where 
V  —  kA  -sA  vk  1 

YV  —  [Aj  ,  A.2  ,  -AyJ. 

The  temporal  update  of  the  posterior  likelihood  on  this 
density  proceeds  according  to  the  usual  rules  of  Bayesian 
filtering.  Given  a  model  of  how  the  JMPD  evolves  over  time 
p(Xfc+1|Xfc),  we  compute  the  time-updated  or  prediction 
density  via  marginalization  of  a  conditional  density: 


p(Xfe+1|Zfe)  =*  I  dXkp{Xk+1\Xk)p(Xk\Zk)  (1) 

p{Xk+1\Zk)  is  referred  to  as  tire  prior  or  prediction  density 
at  tune  k  +  1,  as  it  is  the  density  at  time  k  |  1  conditioned 
on  measurements  up  to  and  including  time  k. 


Given  a  model  of  the  sensor,  p(z\Xk),  Bayes’  rule  is 
used  to  update  the  posterior  density  as  a  new  measurement 
vector  z  arrives  at  time  k  +  1  via 


p(z\Zk) 

p(Xk+1\Zk+1)  is  referred  to  as  the  posterior  or  the  updated 
density  at  time  k  +  1  as  it  is  the  density  at  time  k  + 1  condi¬ 
tioned  on  all  measurements  up  to  and  including  time  k  +  1. 

The  sample  space  of  X  is  very  large.  It  contains  all  pos¬ 
sible  configurations  of  state  vectors  x*.  We  find  that  a  parti¬ 
cle  filter  based  representation  of  the  JMPD  allows  tractable 
implementation  [1],  Tire  particle  filter  approximation  repre¬ 
sents  the  JMPD  by  a  collection  of  weighted  samples,  i.e. 


N part 

p{X\Z)  *  <V( x  -  Xp)  (3) 

p= 1 

Particle  filtering  is  a  method  of  approximately  solving 
tire  prediction  and  update  equations  (1)  and  (2)  by  simula¬ 
tion  [5],  Samples  are  used  to  represent  the  density  and  to 
propagate  it  through  tune.  The  prediction  equation  (1)  is 
implemented  by  proposing  new  particles  from  the  existing 
particles  using  a  model  of  state  dynamics  and  tire  measure¬ 
ments.  The  update  equation  (2)  is  implemented  by  assign¬ 
ing  a  weight  to  each  of  the  particles  that  have  been  proposed 
using  the  measurements  and  the  model  of  state  dynamics. 

Of  particular  interest  in  this  work  is  the  best  way  to 
propagate  samples  through  time  (simulate  (1)).  As  real  tar¬ 
gets  have  time  varying  kinematic  modes,  the  traditional  IMM 
seeks  to  estimate  which  of  the  modes  the  target  is  following 
and  use  this  to  tune  evolve  (predict)  the  density.  Here  we 
extend  this  to  allow  additional  methods  of  time  evolution 
which  are  related  to  the  state  of  the  filter  rather  than  the 
state  of  the  target.  This  allows  the  filter  to  detect  model  vio- 


lations  when  measurements  are  inconsistent  with  the  current 
method  of  time  evolution  and  compensate. 

3.  MULTIPLE  MODEL  TARGET  TRACKING 

In  this  section,  we  outline  tire  IMM  algorithm  [6],  For  sim¬ 
plicity,  we  give  details  for  a  single  target.  Extension  to  mul¬ 
tiple  targets  is  straightforward. 

Real  targets  rarely  obey  a  single  kinematic  model.  The 
IMM  algorithm  estimates  on-line  the  target  mode,  and  uses 
it  for  filtering.  The  designer  selects  a  set  of  M  models  or 
modes  m  =  1  •  •  •  M  that  represent  all  possible  priors  on 
motion  of  the  target  (e.g.  stopped,  accelerating,  perform¬ 
ing  a  coordinated  turn).  Associated  with  each  model  m  is 
the  mode  probability  (probability  the  target  is  following  this 
mode  at  the  current  time).  At  initialization,  mode  probabil¬ 
ities  are  given  based  on  prior  knowledge.  While  the  filter 
tracks  the  target,  mode  probabilities  are  continuously  re- 
estimated  online. 

The  target  mode  is  assumed  to  evolve  in  a  Markov  fash¬ 
ion,  specified  a  priori  by  transition  probabilities  7 r^-  be¬ 
tween  target  mode  i  and  j.  Sensor  measurements  allow 
the  filter  to  update  the  estimate  of  the  mode  probabilities 
at  each  time  step.  A  sub-filter  is  associated  with  each  of  the 
M  modes.  The  sub- filters  estimate  the  state  x  conditioned 
on  both  the  measurements  Z  and  the  mode  i,  i.e.  the  ith 
sub-filter  estimates  p*(x|Z). 

When  a  particle  filter  is  used  as  the  target  tracker,  the 
IMM  algorithm  is  especially  simple.  Each  particle  is  ex¬ 
panded  to  contain  a  mode  estimate  for  each  target.  The  par¬ 
ticle  is  propagated  forward  in  time  according  to  the  dynam¬ 
ics  implied  by  the  modes  of  the  targets.  Transitions  between 
modes  happen  for  each  target  according  to  i r.  The  weighting 
and  resampling  process  work  to  reinforce  modes  that  are  in 
agreement  with  measurements  at  the  expense  of  those  that 
are  not.  Specifically,  for  each  particle  at  tune  k  (which  con¬ 
tains  an  estimate  of  the  mode  mk  and  state  xk)  we  propose 
a  particle  at  tune  k  +  1  according  to  Table  1 . 


Table  1:  Generic  IMM  Particle  Filter  Propogation 
Time  Update 

•  Select  the  mode  :  mk+1  ~  nmkmk+i 

•  Propose  target  state  :  xA  1  1  ~  qmk  \  i  (xk  1  1  |xA.  z) 

Measurement  Update 


Update  weight :  w 


.  ,„*+!  _  ...fcpCzIxfc+Upfx^lx*) 


*0 


The  important  issue  for  efficient  particle  filtering  is  the 


choice  of  importance  density  q.  It  is  known  that  the  op¬ 
timal  importance  density  is  typically  intractable  to  use  for 
particle  proposal  [5],  We  study  here  two  methods  of  parti¬ 
cle  proposal,  both  of  which  use  the  IMM  as  control  logic. 
In  the  first  method  (Section  4)  proposals  are  always  made 
using  target  kinematics  (as  is  commonly  done  in  the  liter¬ 
ature)  and  the  IMM  is  used  to  estimate  which  of  the  kine¬ 
matic  models  the  target  is  following  at  each  time  step.  In 
the  second  method  (Section  5)  proposals  are  made  in  a  more 
generic  way,  allowing  arbitrary  forms  of  q,  again  controlled 
by  the  IMM. 


4.  MULTIPLE  MODELS  ON  THE  TARGET  STATE 

Here  we  consider  the  traditional  application  of  the  IMM, 
tracking  a  target  that  switches  between  kinematic  modes. 
We  specialize  to  the  case  where  the  filter  has  M  =  2  mod¬ 
els:  target  stopped  and  target  moving.  The  filter  estimates 
the  probability  the  target  is  stopped  and  the  probability  the 
target  is  moving  for  each  target. 

Particles  are  always  proposed  using  the  target  kinemat¬ 
ics.  Different  particles  may  have  different  estimates  of  tar¬ 
get  mode  and  hence  different  kinematic  priors.  This  gives 
q(xk+1  \xk ,  z)  =  p(xk+1  |xA)  in  Table  1 ,  leading  to  a  simple 
form  for  the  weight  update,  wk+1  =  wkp( z|xfe+1). 


4.1.  Description  of  Simulation 


Two  targets  move  in  a  surveillance  area.  At  each  time  step, 
measurements  of  the  entire  region  are  made  from  two  sen¬ 
sors.  Sensor  A  measures  the  area  with  a  moving  target  indi¬ 
cator,  characterized  by  detection  probability  P^TI(0)  and 
false  alarm  probability  PjiTI{0).  O  indicates  occupation 
of  a  cell,  i.e.  the  number  of  targets  in  the  cell.  Sensor  B 
measures  the  area  with  a  fixed  (stopped)  target  indicator  and 


is  characterized  by  P^TI(0)  and  Pj  (O).  Both  sensors 
make  thresholded  measurements  on  a  fixed  grid.  Target  mo¬ 
tions  in  the  simulation  are  taken  from  real  recorded  data. 
The  filter  in  the  simulation  is  the  IMMPF  with  two  modes: 
target  stopped  and  target  moving  with  constant  velocity. 

The  modes  are  distinguished  by  their  kinematic  (model) 
updates.  The  target  moving  mode  has  a  model  given  by 
p(xA+1|xA)  ~  N(Fxk,  Q),  i.e.  normally  distributed  with 
vector  mean  Far  and  covariance  Q.  F  performs  the  deter¬ 
ministic  update  and  Q  models  uncertainty  that  accumulates 
during  the  discrete  time  interval.  F  and  Q  were  fit  to  the  tar¬ 
get  motion  using  a  training  set  of  targets.  The  target  stopped 
mode  uses  p(xfe+1|xfc)  ~  (5(xA+1  —  xk).  These  modes  con¬ 
stitute  qi  and  q-2  in  Table  1 . 

We  study  the  trade  between  adaption  time  and  steady 
state  error.  The  parameters  that  control  this  trade  are  in  it, 
where  7 r  =  (|"oving  *°  moving  £“oving.  ‘°  at°pped. ) .  If  tt  allows 

Vf-'stopped  to  moving  /-'stopped  to  stopped  / 

probability  to  flow  from  one  mode  to  another  rapidly  (i.e. 


Steady  State  Error  vs.  Learning  Time  Tradeoff 


Figure  2:  Left  two  plots:  Performance  of  the  IMM  particle  filter  for  different  values  of  the  adaption  parameter,  5.  True  target 
mode  is  indicated  by  the  dark  line.  Both  targets  change  modes  (i.e.  stop  or  stall  moving)  during  the  simulation.  The  filter 
estimates  on-line  mode  probabilities,  and  the  estimate  is  plotted.  For  large  values  of  adaption  parameter  (e.g.  8  =  .2)  reaction 
time  is  fast,  but  steady  state  error  is  large.  Conversely,  for  small  values  (e.g.  <5  =  .002)  reaction  time  is  slow,  but  steady  state 
error  is  small.  Rightmost  curve:  A  plot  of  steady  state  error  versus  time  constant  parameterized  by  8  for  Target  2. 


off-diagonal  elements  are  large),  the  filter  adapts  quickly  but 
has  poor  steady  state  behavior.  Conversely,  slow  adaptation 
corresponds  to  good  steady  state  behavior.  In  this  experi¬ 
ment  we  consider  7r  of  the  form  7 r  =  (1^'5  11(5).  8  plays 

the  role  of  an  adaption  speed  parameter. 


In  the  context  of  a  particle  filter  tracker,  using  the  IMM 
to  model  the  filter  state  may  be  interpreted  as  a  biased  sam¬ 
pling  scheme  for  particle  proposal.  Specifically,  targets  are 
proposed  from  a  mixture  importance  density,  q: 


4.2.  Simulation  Results 

We  show  the  performance  of  the  IMM  at  estimating  target 
modes  for  targets  1  and  2  as  a  function  of  adaptation  param¬ 
eter  8  in  Figure  2.  Target  1  stalls  out  moving  and  then  stops 
at  time  step  58.  Target  2  starts  out  stopped  and  then  starts 
moving  at  time  step  48. 

The  results  show  a  tradeoff  between  steady  state  error 
and  adaption  time.  For  example,  consider  the  curves  (cor¬ 
responding  to  different  values  of  8)  for  Target  2.  We  see 
that  for  small  8  (e.g.  S  =  .0002),  the  filter  is  very  slow  to 
adapt  but  has  very  low  steady  state  error.  Conversely,  for 
larger  8  (e.g.  8  =  .2),  the  filter  is  very  quick  to  adapt  but 
has  large  steady  state  error.  We  summarize  this  trade  in  Fig¬ 
ure  2,  which  shows  a  plot  of  steady  state  error  versus  time 
constant  parameterized  by  the  adaption  parameter  5.  Tire 
actual  transition  rate  from  studying  the  true  target  trajectory 
(which  is  not  available  to  the  filter)  is  8  .02. 


q(x.k+1\xk,zk) 


g1(xfc+1|xfe)  withprob.  0 
q2  (xfc+ 1  j  xfc )  with  prob  1  -0 


i.e.  samples  are  drawn  from  g2  with  probability  0  and  q2 
with  probability  1—0.  This  biassed  sampling  is  accounted 
for  in  the  weight  update  of  the  particles  [5] 


0Qi  (xp+1  |Xp,  z)  +  (1  -/3)g2(xp+1|x*j,z) 

One  should  not  get  the  impression  that  this  interpreta¬ 
tion  is  wedded  to  a  particle  filter  implementation.  It  is  as 
implementation  independent  as  the  traditional  IMM  (recall 
most  of  the  research  on  the  traditional  IMM  has  been  done 
in  the  context  of  Kalman  Filter  tracking).  One  can  envision 
an  IMM  Kalman  Filter  tracker  where  one  models  the  filter 
rather  than  the  target  in  exactly  the  manner  discussed  here. 


5.  MULTIPLE  MODELS  ON  THE  FILTER  STATE 

An  alternate  application  of  the  IMM  strategy  is  multiple 
models  on  the  state  of  the  filter.  Here  we  model  transitions 
in  tracking  error  rather  than  in  kinematic  behavior  of  the  tar¬ 
get.  It  is  straightforward  to  combine  models  relating  to  the 
filter  and  models  relating  to  the  target  but  we  do  not  pursue 
that  here.  We  find  that  this  approach  adds  robustness  to  the 
filter  as  it  allows  the  filter  to  automatically  detect  a  model 
violation  and  compensate  by  adjusting  the  filter. 


5.1.  Description  of  Simulation  I 

We  use  two  models  of  filter  mode:  “target  in  track”  and  “tar¬ 
get  lost”.  The  filter  estimates  on-line  the  probability  that  the 
target  is  being  successfully  tracked  (model  obeyed)  and  the 
probability  that  the  target  has  been  lost  (model  violation). 

Tire  first  model  (target  in  track)  the  kinematics  of  the  tar¬ 
get  is  used  to  update  the  filter,  p(xfc+1|xfe)  ~  N(Fxk,  Q). 

Targets  get  lost  by  the  filter  in  the  following  maimer. 
A  series  of  missed  detections  or  unlikely  maneuvers  cause 


Figure  3:  Performance  of  the  IMM  preventing  lost  targets.  Left:  Percent  of  trials  the  target  is  successfully  tracked  for  different 
choices  of  5.  5  =  0  corresponds  to  always  using  tracking  mode  and  5  =  1  corresponds  to  always  using  searching  mode.  We 
find  that  5  =  .5  performs  best.  Right:  Percent  of  density  in  tracking  mode  and  the  number  of  boundary  crossings  that  occur 
at  each  tune  step.  The  sensor  makes  detection  on  a  fixed  grid,  so  when  a  target  crosses  a  boundary,  the  chance  of  getting  lost 
is  greatest.  It  is  these  occasions  that  the  mode  probabilities  move  to  favor  search  mode  over  tracking  mode. 


particles  (mass  of  the  target  state  density)  to  become  con¬ 
centrated  in  ait  area  where  the  target  is  not  present.  At  that 
point,  the  kinematic  model  is  insufficient  to  allow  the  den¬ 
sity  to  flow  back  to  the  proper  area  of  state  space.  The  target 
is  then  lost  forever.  At  the  point  where  tire  target  has  just 
been  lost,  it  is  critical  to  recapture  or  risk  being  out-of-track 
for  good.  To  address  this  situation,  we  include  a  second 
model  given  by  p(xfe+1|xfe)  ~  N(Fxk,  (^searching)  which 
has  a  large  diffusive  component  Q searching-  hr  tunes  of 
model  violation,  this  second  model  should  be  more  heav¬ 
ily  used  and  the  mass  of  the  state  density  spread  throughout 
state  space  quickly.  Practically  speaking,  particles  should 
be  diffused  more  quickly  from  then  nominal  location.  These 
modes  constitute  q-\  and  qo  in  Table  1 . 

We  study  a  difficult  scenario,  consisting  of  low  SNR 
measurements,  a  small  number  of  particles,  and  a  target  that 
moves  erratically  (i.e.  has  large  Q).  Again,  there  is  an 
adaptivity  parameter  5  which  controls  how  readily  tire  fil¬ 
ter  switches  modes.  A  critical  distinction  in  this  setting  is 
that  the  parameter  no  longer  has  a  direct  physical  interpre¬ 
tation  with  respect  to  the  targets.  Tire  transition  matrix  is 

rjr-  _  /^tracking  to  tracking  ^tracking  to  searching  ^  vn  phnnCP  tn 

\Psearching  to  tracking  ^searching  to  searching  /  * 

use  a  7r  of  the  form  *=(i=S  J).  5  will  control  how  read¬ 

ily  switches  out  of  tracking  mode  and  into  searching  mode. 

5.2.  Results  of  Simulation  I 

We  show  in  Figure  3  algorithm  performance  (percentage  of 
trials  the  target  was  in  track)  versus  tunes  for  several  differ¬ 
ent  choices  of  the  adaptivity  parameter  5.5  =  0  corresponds 
to  using  the  tracking  model  all  of  the  time  while  5=1  cor¬ 
responds  to  using  the  searching  model  all  of  the  tune.  We 


see  that  5  =  .5  outperforms  both  5  =  0  and  5  =  1. 

Unlike  the  earlier  situation  wherein  the  mode  probabil¬ 
ities  eventually  reached  steady  state  of  [1,  0]  or  [0, 1]  cor¬ 
responding  to  moving  or  stopped  mode,  we  find  a  different 
steady  state  behavior  here.  There  is  always  some  mass  in 
each  of  the  searching  and  tracking  modes.  In  Figure  3  we 
also  show  the  mode  probabilities  versus  time  and  we  plot  the 
number  of  boundaiy  crossings  at  each  time  step.  The  sensor 
is  pixelated  and  makes  detections  on  a  grid.  The  most  likely 
place  to  lose  targets  is  when  the  target  moves  from  one  sen¬ 
sor  cell  to  another.  We  see  that  the  probabilities  are  adjusted 
to  give  more  mass  to  the  searching  mode  at  precisely  these 
occasions,  stabilizing  the  filter. 

5.3.  Description  of  Simulation  II 

In  this  simulation  we  consider  two  filter  modes:  a  mode 
where  the  filter  biasses  proposals  towards  target  kinemat¬ 
ics  and  a  mode  where  the  filter  biasses  proposals  towards 
the  measurements.  The  first  mode  should  be  used  if  the  fil¬ 
ter  estimates  that  its  model  of  target  kinematics  is  good  as 
compared  to  the  measurements  it  is  receiving  (e.g.  the  SNR 
is  low).  The  second  model  should  be  used  if  the  filter  esti¬ 
mates  it  is  in  the  opposite  situation. 

We  make  use  of  the  mixing  parameter  [i  (in  (5),  which 
controls  how  readily  the  filter  uses  each  of  the  two  modes. 
This  parameter  is  analogous  to  the  adaption  parameter  in 
earlier  simulations  as  it  controls  switching  between  modes. 
We  wish  to  determine  how  filter  performance  is  effected 
by  choice  of  fi.  As  ft  — ►  1,  the  filter  uses  the  kinematics 
exclusively  when  evolving  the  target  state  density  through 
tune  (i.e.  ignores  the  measurements).  As  p  — >  0.  the  filter 


SNR  =  3.6dB  SNR  =  11 ,9dB  SNR  =  19.4dB 


Figure  4:  Tracking  error  as  a  function  of  ft  for  low,  medium  and  high  SNR  (SNR  known  to  the  filter).  As  ft  — >  1,  the  filter  uses 
vehicle  kinematics  exclusively  to  time  update  the  density.  Conversely,  as  ft  —>  0,  the  filter  uses  measurements  exclusively  to 
time  update  the  density.  As  is  seen  in  the  figures,  for  low  SNR  measurements  ft  «  1  yields  the  best  tracking  performance 
(lowest  tracking  error).  On  the  other  hand,  for  high  SNR  measurements,  ft  «  0.5  yields  the  best  tracking  performance. 


uses  the  measurements  exclusively  when  evolving  the  target 
state  density  through  time  (i.e.  ignores  the  target  kinemat¬ 
ics).  Of  course,  both  the  measurements  and  the  kinematics 
are  always  used  when  weighting  the  particles,  in  the  maimer 
given  by  eq.  (5). 

5.4.  Results  of  Simulation  II 

Figure  4  shows  results  versus  ft  of  tracking  simulations  in 
three  situations:  low,  medium  and  high  SNR.  For  the  low 
SNR  case,  the  best  performance  occurs  with  /?  ~  1,  which 
implies  that  the  measurements  are  ignored  when  evolving 
the  density  through  time.  This  is  consistent  with  the  fact 
that  the  measurements  are  poor  and  ought  not  be  allowed  to 
unduly  influence  the  propagation  of  the  density.  Conversely, 
in  the  high  SNR  case,  ft  ss  0.5  yields  the  best  tracking  per¬ 
formance.  This  implies  that  roughly  half  of  the  particles 
should  be  proposed  using  the  kinematics  and  half  from  the 
measurements.  Since  the  measurements  are  very  reliable, 
using  them  to  bias  particle  proposals  leads  to  improved  per¬ 
formance. 

6.  CONCLUSIONS 

We  have  investigated  the  use  of  the  IMM  algorithm  in  the 
setting  of  particle  filter  based  multitarget  tracking.  First,  we 
considered  application  to  targets  that  switch  between  kine¬ 
matic  modes.  Second,  we  presented  experiments  where  the 
IMM  uses  multiple  models  on  the  state  of  the  filter  rather 
than  on  the  state  of  the  target.  In  the  context  of  particle  fil¬ 
ter  target  tracking,  this  technique  may  be  viewed  as  a  biased 
sampling  scheme  for  particle  proposal.  Through  simulation, 
we  showed  that  this  strategy  adds  robustness  by  helping  to 
prevent  the  filter  from  losing  targets. 

The  approach  we  take  has  the  merit  of  a  unifying  frame¬ 
work  of  Bayesian  posterior  propagation  of  a  multiple  target 


state  vector  given  noisy  measurements.  We  have  previously 
demonstrated  that  JMPD  provides  a  reliable  tracking  capa¬ 
bility  in  a  fully  Bayesian  setting  [1],  This  paper  goes  further 
in  illustrating  the  benefits  in  using  multiple  models  for  tar¬ 
gets  whose  kinematics  may  be  very  different  and  therefore 
do  not  obey  the  same  linear  diffusion  model. 
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Overview 


We  are  interested  in  tracking  a  collection  of  moving  targets  by  recursively 
estimating  the  joint  multitarget  probability  density  (JMPD). 

Multiple  model  filtering  addresses  the  fact  that  real  targets  change 
kinematic  modes  over  time  (e.g.  moving  targets  may  stop  or  begin  rapid 
acceleration). 

Ideally  a  filter  should  estimate  the  kinematic  mode  of  the  target. 

We  first  review  material  that  has  been  presented  elsewhere  (and  is  not 
the  main  subject  of  this  talk)  but  is  prerequisite  knowledge. 

-  A  Bayesian  method  of  multi-target  tracking:  the  JMPD 

-  A  computational  method  of  estimating  the  JMPD  on-line,  the  multitarget 
particle  filter. 

We  then  give  the  details  of  the  multiple  model  particle  filter  including  a 
new  interpretation  based  on  modeling  the  state  of  the  filter  rather  than 
the  state  of  the  target. 


Overview 


The  Joint  Multitarget 
Probability  Density  (JMPD) 


This  methods  developed  here  rely  on  a  multiple  target  tracking  paradigm  based  on 
recursive  estimation  of  the  Joint  Multitarget  Probability  Density  (JMPD). 

-  To  estimate  the  number  of  targets  and  their  states,  we  estimate  the  JMPD,  which 
captures  all  of  the  coupling  between  targets. 

-  This  is  different  from  traditional  multitarget  tracking  algorithms  such  as  MHT,  JPDA,  etc. 
in  that  we  are  interested  in  estimating  the  full  joint  multitarget  density  and  the  JMPD 
allows  arbitrary  measurements,  kinematics  and  densities. 

We  give  a  particle  filter  (PF)  algorithm  for  recursively  estimating  the  JMPD 

-  The  PF  is  an  implementation  (a  computational  methodology)  of  estimating  the  JMPD. 

-  The  PF  provides  tractability  not  available  in  conventional  methods  (e.g.  grid-based). 

-  The  PF  algorithm  uses  an  adaptive  sampling  scheme  that  exploits  the  multitarget  nature 
of  the  problem  and  automatically  factorizes  the  JMPD  when  possible. 

•  In  the  (extreme)  case  where  targets  are  well  separated  one  can  simply  track  each  target 
individually  -  i.e.  the  JMPD  breaks  down  to  a  product  of  single  target  densities. 

•  More  commonly,  some  targets  are  well  separated  (independent)  and  others  are  closely  spaced 
(i.e.  coupled  -  some  measurement  ambiguity  exists).  In  this  case  the  JMPD  breaks  down  into  a 
product  of  densities,  some  of  which  are  single  target  densities  and  some  of  which  are  multitarget 
densities  involving  2,  3,  etc.  targets. 


The  JMPD  :  Formulation 


The  state  of  an  individual  target  is  modeled  by  x,  e.g. 

» 

\  =  [xxy  y] 

We  are  interested  in  tracking  multiple  targets,  so  the  state  vector  of  the 
system  (where  the  number  of  targets  7" is  unknown)  is  defined  as 

t 

X  =  [x7  x2  ...  xT_j  xT\ 

The  central  element  that  summarizes  our  knowledge  of  the  system  at  time 
k  is  the  joint  multitarget  probability  density  (JMPD), 

p{xk\zk) 

which  is  to  be  estimated  based  on  a  sequence  of  noisy  measurements 
taken  over  k time  steps,  z*  =  (z1  U  z2  ...Uz‘( 


The  JMPD  :  Formulation 


•  The  space  in  which  X  resides  is  quite  large.  As  examples,  the  sample  space  of 
p(Xk -\Zk)  contains 

p(0  I  Zk),  The  posterior  probability  density  for  no  targets  in  the  surveillance  region 

p(x1?x2 1  Zk),  The  posterior  probability  density  for  two  targets  in  states  x  1  and  x2 
Notice  the  permutation  symmetry  inherent  in  JMPD 

•  The  target  motion  is  modeled  as  Markov  using  a  Kinematic  prior 

p(Xk  \Xk~‘) 

•  The  sensor  output  is  modeled  using 

p( zk  IX*) 


The  JMPD 


In  principle,  time  evolution  of  the  posterior  can  be  computed  via  a  two-  step 
recursion,  prediction  and  update: 

Prediction  (generating  the  Kinematic  prior) 

p(x*  \zk~1)=\ p(xA'  i  i  z *_7)zx*_7 

Update  (Bayes’  rule  to  Incorporate  Measurements) 

k  IX*)p(x*  \  zk~1 

where  p(zk  lZk~')=jp(zk  IX*)p(x*  IZ k~‘)dXk 

Notice 

-  This  is  quite  general  in  that  there  is  no  assumption  of 

•  Linear  target  kinematics 

•  Gaussian  noise  corrupting  the  measurements 

•  Linear  measurement  to  target  relationship 

•  Gaussian  state  density 

-  No  need  for  contacts/detections/threshold  exceedances  -  only  the  probability  of  the 
measurement  given  the  state  is  necessary. 

-  There  is  no  explicit  measurement  to  target  association. 


How  do  we  implement  the  JMPD? 


One  method  of  solving  the  prediction  and  update  equations  is  to  discretize  the 
density  on  a  fixed  grid  and  solve  using  finite  difference  methods.  This  method  is 
practical  only  for  small  state  spaces. 

-  For  example,  in  the  case  where  there  are  1 0  targets,  each  of  which  is  described  by  a  4d 
state  vector,  we  have  a  40  dimensional  state  vector. 

-  If  we  form  a  grid  with,  say,  1 00  cells  for  each  dimension  the  number  of  discrete  cells 
needed  to  describe  the  space  is  1 0040. 

A  more  tractable  solution  strategy  which  eliminates  the  need  for  discretization  and 
a  fixed  grid  is  to  use  the  Monte  Carlo  method  known  as  particle  filtering. 


Y  position 


The  Particle  Filter 
Implementation  of  JMPD 


Let  the  Joint  Multitarget  Probability  Density  (JMPD) 

p(x1,x2,...xT_1,xT  I  Z)  =  p(X  I  Z),  T  =1. ..00 

be  approximated  by  N  weighted  samples  (particles)  as 

P(XIZ)»  X  wpS(X-Xp) 

P=1 


X  position 


Target  Density,  PF  representation 


The  Particle  Filter 
Implementation  of  JMPD 

Each  of  the  particles  Xp  is  a  sample  drawn  from  the  JMPD  p(Xk\Zk) 

-  Therefore,  a  particle  will  contain  an  estimate  of  both  the  number  of  targets  in  the 
surveillance  region  and  the  states  of  each. 

» 

A  particle  Xp  will  be  written  as  Xp  =  [xpl  xp2  ...  xpr_j  xpT\ 

-  Each  x  •  in  the  particle  Xp  is  the  state  vector  of  a  particular  target,  and  will  be  called  a 
partition  of  the  state  vector. 

-  A  particle  may  have  0,  1,  ...  ao  partitions,  each  partition  corresponding  to  a  different 
target. 

-  The  number  of  partitions  in  a  particle  is  that  particles  estimate  of  the  number  of  targets 
in  the  surveillance  region. 

We  want  to  generate  a  set  of  samples  (particles)  that  approximate  the  joint 
multitarget  probability  density  p(Xk\Zk). 

The  key  element  is  the  importance  density  -  i.e.  how  particles  at  time  k+1  are 
generated  from  particles  at  time  k. 


The  Particle  Filter 
Implementation  of  JMPD 

We  use  an  advanced  adaptive  sampling  scheme  that  allows  for 
computational  tractability  even  in  very  high  dimensionality  state  spaces. 

-  The  importance  density  specifically  exploits  the  multitarget  nature  of  the 
problem:  It  is  an  adaptive  multi-partition  proposal  strategy  that  determines 
which  partitions  (targets)  are  acting  independently  and  factorizes  the  problem 
into  smaller  sub-problems  as  appropriate. 

-  The  importance  density  uses  current  measurements  in  order  to  heard 
proposals  towards  the  correct  areas  in  state  space. 

These  particle  filtering  techniques  are  the  subject  of  another  work  and  will 
not  be  elaborated  on  further  in  this  talk. 


Example  of  Tracking  a 
Single  Target  Using  a  Particle  Filter 


Approximate  the  density  by  a  set  of 
weighted  samples  (particles) 

p(x  I Z)  «  X  wpS(x-xp) 

p=i 

At  each  time  step,  propose  new  particles 
from  the  existing  particles  based  on  the 
importance  density 

4x*lx-Z*Mx*lx-Z*) 

Weight  the  particles  based  on  the 
measurement  likelihood 
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Resample  the  particles  (if  necessary) 


The  Interacting  Multiple  Model  Filter 

•  To  implement  the  Bayesian  filter  one  needs  a  model  of  target  kinematics p(xA  I XA_/ 

•  We  focus  here  on  the  single  target  model  of  kinematics  p(*k  I  xA_7) 

•  A  reasonable  model  for  targets  on  the  freeway  (known  as  the  CV  model) 
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•  Where  w  is  a  4x1  matrix  of  Gaussian  distributed  errors. 


•  The  problem  is  that  targets  eventually  leave  the  freeway. 

•  Moral  of  the  story:  “Real”  Targets  don’t  obey  a  single  kinematic  model;  a  filter 
needs  the  ability  to  switch  between  multiple  models  as  target  behavior  changes 

-  Targets  may  :  stop  moving,  move  with  constant  velocity,  rapidly  accelerate,  make  a 
coordinated  turn. 


The  Interacting  Multiple  Model  Filter 


The  traditional  IMM  application  is  a  filter  that  switches 
between  a  collection  of  kinematic  models  while  tracking. 

-  Conceptually  we  think  of  estimating  both  the  state  of  the  target  and  the 
kinematic  mode  it  the  target  is  in  (e.g.  moving,  stopped,  turning,  etc.) 

-  We  enumerate  a  set  of  possible  target  modes,  define  the  kinematics  of  each 
mode  and  the  transition  rates  between  each  mode. 

•  The  set  of  all  possible  target  modes  defined  up  front  (e.g.  stopped,  moving,  etc) 

•  The  transition  rates  between  modes  defined  up  front  as  well  (e.g.  How  often  does 
moving  target  stop  (and  vice  versa)?) 

•  These  a  priori  probabilities  may  be  time  varying  and/or  state  dependent.  We  focus 
on  fixed  models  here  for  expositional  simplicity. 


/^moving  to  moving  /^moving  to  stopped 
/^stopped  to  moving  /^stopped  to  stopped 


Pm0vinS{*k+I  Ix*)~W(Fx*.Q) 

P stopped  (x*+/  1  x‘  )~  <?(x*+/  -  x*  ) 


The  Interacting  Multiple  Model  Filter 


Most  past  research  on  the  IMM  involved  Kalman  filters  on  single  targets. 

-  Many  filters  are  run  simultaneously,  each  corresponding  to  a  possible  target  mode. 

Each  sub-filter  has  an  associated  weight  or  probability. 

-  The  filters  interact  (exchange  information)  via  mixing  probabilities 

-  The  final  estimate  is  a  combination  (weighted  average)  of  each  filter’s  estimate,  with  the 
weights  being  the  mode  probabilities 

-  The  weights  for  each  mode  are  based  on  which  model  best  fits  the  data  (and  the 
transition  rates) 

The  PF  method  allows  a  particularly  simple  implementation  of  IMM. 

-  The  target  state  is  augmented  to  include  target  mode,  which  is  treated  as  another 

» 

variable  to  estimate  x  =  [x  x  y  y  m] 

-  The  estimated  target  modes  are  used  to  propagate  (time  update)  a  particle 

•  In  particle  filtering  terminology,  the  importance  density  is  always  the  filter  estimate  of  target 
kinematics.  However,  the  estimate  of  kinematics  changes  with  time. 

-  From  the  JMPD  one  can  determine  all  quantities  of  interest  -  in  particular  state 
estimates  (including  kinematic  and  mode  estimates) 


Simulation  Results 


The  speed  of  adaptation  (time  it  takes  to  recognize  a  mode  change)  is 
controlled  by  the  transition  matrix. 

For  the  purposes  of  creating  a  clean  simulation,  we  consider 

-  A  two  model  problem:  target  is  stopped  or  target  is  moving. 

-  Transition  probabilities  of  a  very  restricted  form 


Amoving  to  moving 

Amoving  to  stopped 

~l-8 

8 

P stopped  to  moving 

P stopped  to  stopped 

8 

i-8_ 

Question:  How  does  performance  change  as  a  function  of  5? 

-  We  measure  performance  in  two  ways:  How  fast  the  filter  figures  out  the 
target  has  changed  modes  and  what  is  the  steady  state  error  associated  with 
the  filter. 


Simulation  Results 


•  Black  =  Truth 

•  Target  “2”  changes  from  stopped  to  moving  at  time  48. 

•  Target  “3”  remains  moving  for  the  entire  simulation. 


/^moving  to  moving 

Anoving  to  stopped 
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/^stopped  to  moving 

/^stopped  to  stopped 
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Target  3 


Target  2 


Simulation  Results 
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Multiple  Models  for  Lost  Targets 

•  In  scenarios  with  low  SNR  or  highly  erratic  target  motion, 
targets  may  be  lost  by  the  filter  and  never  recovered. 


Multiple  Models  for  Lost  Targets 


We  reinterpret  the  multiple  model  idea  as  multiple  models  on  the  state  of 
the  filter  (rather  than  on  the  state  of  the  target) 

We  remedy  filter  brittleness  by  switching  into  a  different  mode  of  particle 
proposals  as  targets  start  to  get  lost. 

The  filter  determines  that  measurements  are  not  consistent  with  proposed 
target  state  and  modifies  proposal  process  by  switching  modes. 


True  model 
of  kinematics 


*■  PtrackmM+‘  1  X‘)~  W(Fxt'Q/) 
P^„/,/„gi(x‘+;lx‘)~'v(Fx‘,Q2) 
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This  is  a  Biased  Sampling 
Scheme  for  Particle  Proposal 


•  The  state  of  the  target  has  not  changed;  only  the  filter  itself  changes. 

-  Unlike  the  earlier  application,  where  the  importance  density  was  always  the 
target  kinematics  (although  it  changed  with  time),  here  we  may  use  something 
other  than  target  kinematics  for  proposal. 

-  This  biased  sampling  scheme  must  be  reflected  in  the  particle  weights. 


with  probability  p1 
with  probability  p2 
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Comparison  of  IMM  Filters 


Traditional  application: 

-  Multiple  modes  on  the  state  of  the 
target:  e.g.  “moving”  and  “stopped” 

-  The  state  of  the  target  changes  and 
therefore  the  filter  model  ought  to 
change  to  reflect  that  the  physics  have 
changed 

•  The  importance  density  is  p(X*/X*'V  at 
all  times. 

-  If  a  measurement  arrives  and  agrees 
with  a  particle  in  mode  /  that  mode 
should  be  strengthened  (its  weight 
increases) 

-  The  models  are  very  different, 

•  We  expect  the  weight  vector  to 
converge  to  [1  0]  or  [0  1] 

•  We  expect  very  little  model  crossover 
except  when  the  target  changes  mode. 


New  application: 

-  Multiple  modes  on  the  state  of  the  filter:  e.g. 
“tracking”  and  “searching” 

-  The  state  of  the  target  has  not  changed;  only 
the  filter  itself  changes. 

•  We  are  using  a  biased  importance  density  (i.e. 
a  biased  sampling  scheme)  to  compensate  for 
the  filter  losing  the  target. 

-  If  a  measurement  arrives  and  agrees  with  a 
particle  in  searching  mode  that  particle 
should  transition  into  tracking  mode. 

-  The  models  are  quite  similar 

•  Don’t  expect  weight  vector  to  converge  to  [1  0] 
or  [0  1].  Expect  a  blend  of  the  models  to  be  the 
steady  state  weight. 

•  Instead  of  recognizing  and  adapting  to  a  mode 
change,  goal  is  to  recognize  the  beginning  of  a 
mode  change  and  subtly  flow  probability  into 
the  searching  mode  to  prevent  a  mode  change 
(i.e.  prevent  the  target  from  getting  lost). 


Simulation  Results 
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Simulation  Results 
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Conclusions 


Real  targets  are  poorly  modeled  by  a  single  kinematic  model. 

The  traditional  multiple  model  filter  allows  for  successful  tracking  of  a 
target  that  changes  kinematic  modes. 

-  The  burden  is  on  the  filter  designer  to  decide  how  many  models  and  what  the 
transition  rates  should  be. 

-  We  see  the  expected  tradeoff  between  weight  adaptation  and  steady  state 
weight  error 

Applying  the  same  idea,  but  having  multiple  models  on  the  state  of  the 
filter  has  added  a  robustness  to  the  tracker 

-  Modes  that  allow  the  filter  to  propose  particles  using  something  other  than  the 
true  target  kinematics  can  prevent  the  filter  from  losing  track  of  the  target. 

•  Large  diffusion  modes  documented  here. 

•  Modes  that  sample  directly  from  the  measurements  documented  in  the  paper. 


